Street side maps and paths

ABSTRACT

The claimed subject matter relates to a computer-implemented architecture that can generate a map. The map can be a hybrid between an orthographic projection map and street-side images, thus including useful aspects from both types of representations. For example, an orthographic projection map is very effective at presenting global relationships among the features of the map, but not effective at presenting local detail. In contrast, street-side images show excellent detail, but do not convey the global information of an orthographic projection map. The hybrid map can thus provide a richer set of information than conventional maps, and can also display objects/features of the hybrid map in multiple perspectives simultaneously on a single representation that is printable.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation-in-part of co-pending U.S. patentapplication Ser. No. 11/323,241, entitled “PHOTOGRAPHING BIG THINGS”filed on Dec. 30, 2005, which claims priority to U.S. ProvisionalApplication Ser. No. 60/723,576, filed Oct. 4, 2005, entitled“PHOTOGRAPHING BIG THINGS.” This application is also related toco-pending U.S. patent application Ser. No. ______ (MSFTP1451US),entitled “A USER INTERFACE FOR VIEWING STREET SIDE IMAGERY” and toco-pending U.S. patent application Ser. No. ______ (MSFTP1390US),entitled “INDEXING AND CACHING STRATEGY FOR LOCAL QUERIES”. Theentireties of these applications are incorporated herein by reference.

BACKGROUND OF THE INVENTION

Maps have been in existence for many thousands of years and employed fora variety of purposes relating to travel, logistics, planning, etc. Onetype of map is a general purpose map, which typically provides anorthographic projection of a surface (e.g., the surface of the Earth oranother celestial body) or simply the top-down view of an orthographicprojection of an object (e.g., the layout of a large building . . . ).As such, general purpose maps can provide useful information that canaid in understanding or quickly referencing how various features on themap relate to one another in terms of distance, direction, orientation,size etc.

In addition, the concept of an orthographic projection map (e.g., ageneral purpose map) can be augmented in a variety of ways to providemore specialized maps. For example, a road map is designed such thatroadways or paths of a surface are the central features. On the otherhand, a physical map generally focuses on landforms and bodies of waterand often employs lines, shading, tints, spot elevations and colors toshow elevation and distinguish mountains from lowlands. Of course, thereare many other specialized maps based upon the concept of anorthographic projection, such as political maps, relief maps,topographical maps and the like, and each can provide specializedinformation.

However, regardless of the type of map employed, there are certaintrade-offs between what information will be provided to the viewerversus what information will be omitted. Often these trade-offs areinherent in the map's construction parameters. For example, whereas aphysical map may be more visually appealing, a road map is more usefulin, e.g., assisting travel from one point to another over common routes.Sometimes, map types can be combined such as a road map that alsodepicts land formation, structures, etc. However, when the purpose ofthe map is to assist travel, certain other information, such as, e.g.,political information may not be of much use. Thus, incorporating thisinformation may detract from utility of the map. Accordingly, a good mapis one that provides the viewer with useful information, but not so muchthat extraneous information detracts from the experience.

Another way of depicting a certain location that is altogether distinctfrom orthographic projection maps is by way of first-person perspective.Often this type of view is from a ground level, typically represented inthe form of a photograph, drawing, or some other image of a feature asit is seen in the first-person. First-person perspective images, such as“street-side” images, can provide many local details about a particularfeature (e.g., a statue, a house, a garden, or the like) thatconventionally do not appear in orthographic projection maps. As such,street-side images can be very useful in determining a location basedupon a particular point-of-view because a user can be directly observinga corporeal feature (e.g., a statue) that is depicted in the image. Inthat case, the user might readily recognize that the corporeal statuteis the same as that depicted in the image, whereas with an orthographicprojection map, the user might only see, e.g., a small circle thatrepresents the statute that is otherwise indistinguishable from manyother statutes similarly represented by small circles.

However, while street-side images are very effective at supplying localdetail information such as color, shape, size, etc., they do not readilyconvey the global relationships between various features resident inorthographic projection maps, such as relationships between distance,direction, orientation, etc. Accordingly, current approaches tostreet-side imagery/mapping have many limitations. For example,conventional applications for street-side mapping employ an orthographicprojection map to provide access to a specific location then separatelydisplay first-person images at that location. That is, a user can selecta point from an orthographic projection map, and then be served local,first-person images of the selected location. As such, many difficultiesarise.

For example, it is often difficult to orient the displayed, local imageswith the global, orthographic projection map. Hence, while the usermight easily match an image with the corporeal feature(s) she iscurrently viewing (or remembers from past experience), she must mentallytranslate the orientation of the image to know, e.g. that turning leftis equivalent to heading north on the global map. Often, this can leadto confusion for the user. Similarly, as well as trouble in obtainingthe global orientation, there also exists trouble obtaining the globalposition when browsing the local images. For instance, a user might wanttake a particular path because the local images show it has, e.g. moreshade, more shops or the like, but may not be able to readily identifywhich side of the street those images portray.

Additionally, the first-person images provide only localized informationbased upon a selected position, which makes searching or explorationvery expensive/inefficient in terms of time and image queries. Forinstance, if a user knows exactly where to look on the global map, thenclicking at that location will serve up the desired local image.However, if the user does not know the exact location, but rather onlyknows the general whereabouts of a particular feature on the global map,then searching and/or exploring for that particular feature can be avery lengthy process. Furthermore, conventional applications forstreet-side imagery are interactive solutions and require constantaccess to new local images whenever the user wants to see localinformation from a different point. Hence, there is no convenient way toprint the full information necessary for a larger area such as an a cityblock, a neighborhood or an entire city. Therefore, in manycircumstances, the user must have wireless access and appropriateequipment to display the local images in order to take full advantage ofthese services.

Accordingly, there is a need in the street-side imagery and mappingspace for a solution that can provide local images in connection withglobal map information. And, further, that can mitigate the difficultiesassociated with mental translations between the images and the map, makesearching for particular features or areas more efficient, and also becapable of delivering this information in a compact manner that can beprinted, and thus available to a traveler without the need for specialequipment.

SUMMARY OF THE INVENTION

The following presents a simplified summary of the claimed subjectmatter in order to provide a basic understanding of some aspects of theclaimed subject matter. This summary is not an extensive overview of theclaimed subject matter. It is intended to neither identify key orcritical elements of the claimed subject matter nor delineate the scopeof the claimed subject matter. Its sole purpose is to present someconcepts of the claimed subject matter in a simplified form as a preludeto the more detailed description that is presented later.

The claimed subject matter disclosed and claimed herein, in one aspectthereof, comprises system that can provide local information about anobject at or near a feature on a global map. To the accomplishment ofthe foregoing and other related ends, a hybrid map can be generated thatincludes useful features of local images as well as those fromorthographic projection maps. For example, local or street-side imagesthat contain specific local details such as appearance, color, shape,etc. can be inserted and/or interpolated into an orthographic projectionmap, which itself provides useful global context such as orientation,size, distance, direction, etc. conventionally lacking in local images.

In particular, the system can include a global map (typically anorthographic projection map) consisting of a feature at a featureposition, as well as a local image (typically a ground-level,first-person perspective image) of the feature, or objects and/or ascene visible from the feature position. For example, if the feature onthe global map is a garden, then the local image can be a photograph orsome other rendering of the garden. Additionally or alternatively, ifthe feature is a road, then the local image can contain an object or ascene that is visible from the road (e.g., the position of thefeature/road on the global map). In accordance therewith, the system canalso include an interpolation component that embeds the local image inthe global map to produce the hybrid map.

The interpolation component can embed the local image at or near thefeature position and can determine the orientation of the local image,the display style to be used, the importance of a local image (or anobject therein), and/or the like. In accordance with one aspect of theclaimed subject matter, images (or objects therein) can be emphasized orde-emphasized based upon the importance. For example, important localimages can be emphasized by increasing their size, changing thecontrast, highlighting, and/or the like. Less important images can bede-emphasized in a similar manner or suppressed from the hybrid mapaltogether. Whether a particular local image (or object) is importantcan depend upon user preferences or other factors. For instance, a userthat is exploring an area might want detailed information on all nearbypoints of interest. In contrast, a traveler traveling along a plannedroute may only be interested in images at or near junctions where theroute changes course.

In accordance with another aspect of the claimed subject matter, thelocal images can be single images, three-dimensional models, panoramas,or combinations thereof. In addition, the local image can include ahyperlink that provides further information about the local imageitself, an object in the local image, the feature, the feature position,and/or an object at or near the feature position. Furthermore, the localimages can depict objects in the scene from different directions. Thus,local images can be arranged on the hybrid map such that multipleperspectives of one or many objects can be visible simultaneously. Assuch, the hybrid map can provide a single, printable representation ofan area, complete with information that conventionally requires manydifferent representation and/or multiple queries/requests.

The following description and the annexed drawings set forth in detailcertain illustrative aspects of the claimed subject matter. Theseaspects are indicative, however, of but a few of the various ways inwhich the principles of the claimed subject matter may be employed andthe claimed subject matter is intended to include all such aspects andtheir equivalents. Other advantages and novel features of the claimedsubject matter will become apparent from the following detaileddescription of the claimed subject matter when considered in conjunctionwith the drawings.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a block diagram of a system that provides local information ator near a feature on a global map.

FIG. 2A is an exemplary road map, which is a specialized orthographicprojection map wherein the primary features are roads.

FIG. 2B depicts an exemplary local image comprising a panorama of astreet-side scene.

FIG. 3 illustrates an exemplary hybrid map with a local imageinterpolated over an orthographic projection map.

FIG. 4 illustrates another exemplary hybrid map of a portion of a globalmap.

FIG. 5A depicts an exemplary hybrid map in accordance with the claimedsubject matter.

FIG. 5B depicts an exemplary hybrid map in accordance with the claimedsubject matter with the local images enhanced.

FIG. 6A illustrates an exemplary hybrid map based upon 3-D models of anobject and/or scene.

FIG. 6B illustrates an exemplary hybrid map with the 3-D modelsenhanced.

FIG. 7 depicts an exemplary hybrid map in accordance with the claimedsubject matter.

FIG. 8 is a block diagram of an exemplary corporeal scene in which alocal image can be captured.

FIG. 9 is an exemplary hybrid map with the local image properly orientedwith respect to an orthographic projection.

FIG. 10 illustrates an exemplary a computer-implemented system that canprovide local information at or near a feature on a global map

FIG. 11 is an exemplary flow chart of procedures for generating a hybridmap that can provide local detail information and global map context.

FIG. 12A is a prior art map of ancient Jerusalem that depicts the use ofperspective from a single point-of-view.

FIG. 12B is a prior art map of a contemporary city that depictsthree-dimensional perspective of buildings from a dominantpoint-of-view.

FIG. 13 illustrates a block diagram of a computer operable to executethe disclosed architecture.

FIG. 14 illustrates a schematic block diagram of an exemplary computingenvironment.

DESCRIPTION OF THE INVENTION

The claimed subject matter is now described with reference to thedrawings, wherein like reference numerals are used to refer to likeelements throughout. In the following description, for purposes ofexplanation, numerous specific details are set forth in order to providea thorough understanding of the claimed subject matter. It may beevident, however, that the claimed subject matter may be practicedwithout these specific details. In other instances, well-knownstructures and devices are shown in block diagram form in order tofacilitate describing the claimed subject matter.

As used in this application, the terms “component” and “system” areintended to refer to a computer-related entity, either hardware, acombination of hardware and software, software, or software inexecution. For example, a component may be, but is not limited to being,a process running on a processor, a processor, an object, an executable,a thread of execution, a program, and/or a computer. By way ofillustration, both an application running on a server and the server canbe a component. One or more components may reside within a processand/or thread of execution and a component may be localized on onecomputer and/or distributed between two or more computers.

As used herein, the terms to “infer” or “inference” refer generally tothe process of reasoning about or inferring states of the system,environment, and/or user from a set of observations as captured viaevents and/or data. Inference can be employed to identify a specificcontext or action, or can generate a probability distribution overstates, for example. The inference can be probabilistic-that is, thecomputation of a probability distribution over states of interest basedon a consideration of data and events. Inference can also refer totechniques employed for composing higher-level events from a set ofevents and/or data. Such inference results in the construction of newevents or actions from a set of observed events and/or stored eventdata, whether or not the events are correlated in close temporalproximity, and whether the events and data come from one or severalevent and data sources.

As used herein, the terms “street-side” and/or “local” when referring toimages, views, and/or perspectives can denote a first-person view fromthe perspective of ground level, street level, or another relevantposition along a trafficked path such as road or corridor, etc. Thefirst-person view can be, e.g. an image that represents a view from afeature position, or a view of the feature. Local image and street-sideimage can be used interchangeably herein and can be a single image, apanorama (e.g., employing technologies such as push-broom, imagestitching, or any other technology for constructing a panorama), and/ora 3-D model of the feature. In the case where the local image is a 3-Dmodel, the model can be projected from a top-down view such that all thesides of the model are visible simultaneously.

Similarly, the term “global map”, as used herein can denote a top-down,orthographic projection of a surface and can depict various features ofthe surface. The term “road map” can refer to a specialized global mapin which the primary features are roads, paths, corridors, and/or anypotential route of travel between locations. As used herein, the term“perspective axis” can refer to an axis representing the perspective ofthe image. For example, if the image is a photograph of a feature or aphotograph from a feature position, then the perspective axis can be theline of sight between the camera position when the photograph wasimaged, and the scene depicted by the image in corporeal space. Hence,if the camera photographs a scene that is due north of the cameraposition, the perspective axis will run due north on an orthographicprojection map (e.g. a global map).

Referring initially to FIG. 1, a computer-implemented system 100 thatcan provide local information at or near a feature on a global map isillustrated. Generally, the system 100 can include a global map 102 witha feature 104 at a feature position 106, denoted P_(F). Typically, theglobal map 102 will be an orthographic projection of a spherical surfacesuch as the Earth or another celestial body. However, it is to beappreciated that the global map 102 can also be the top-down,orthographic projection of an object such as a building (e.g., atop-down representation of the layout of the structure showing internalfeatures such as walls, corridors, etc.).

The global map 102 can be oriented with a northern direction along thesurface pointing up on the global map 102, as depicted by compose rose108. It is to be appreciated that the global map 102 can be stored in,e.g. computer-implemented data structures and, as such, the featureposition 106 can be represented in standard Cartesian coordinates, e.g.P_(F)=(P_(x), P_(y)), wherein each point, P, can be, e.g. a pixel forthe global map 102. However, this need not be the case and other ways ofrepresenting the global map 102 as well as the components 104-108 arecontemplated and are considered to be within the spirit and scope of thedisclosure and appended claims. It is also to be understood that for thesake of brevity and understanding only a single feature 104 is depictedon the global map 102, however; the global map 102 can include aplurality of features 104, each at a feature position 106.

The global map 102 can be a general map and can also be a specializedorthographic projection of a surface such as a physical map or a roadmap. Accordingly, the feature 104 can be substantially any elementuseful for providing location information to a user of the global map102. For example, the feature 104 can be a road, path, waterway, etc.(or portion thereof) as is common in the case where the global map 102is a road map. Additionally or alternatively, the feature 104 can be aland formation, a building, a statue, a garden, or substantially anyother potential point of interest. Moreover, this concept can begeneralized to other types of maps as well. For instance, interior mapsof shopping malls, where the images can be the facades of the shops; oran interior map of an apartment, where the images of all the walls canbe projected on top of the apartment blue print.

For example, FIG. 2A illustrates an exemplary global map 202 in whichthe global map 202 is a road map. Accordingly, the basic features 204 ofthe global map 202 are roads. As an orthographic projection, the globalmap 202 is very effective at communicating certain global informationsuch as distance, direction, orientation, size etc. For instance, a usercan readily ascertain which way is north (e.g., up on the global map202), when and where a road curves, whether particular roads areparallel or perpendicular to each other, whether one road is longer orshorter than another, etc. In addition, the roads can be identified witha road name 206 as well as an indication (e.g., with directional arrows208) that a road is a one-way road.

While the global map 202 can present a great deal of information interms of the positive features 104 (e.g., roads), a user can also beapprised of much information by what is not positively displayed. Forexample, the negative space 210 represents a city block, bounded on allsides by roads. Accordingly, while not expressly indicated on the globalmap 202, a user can infer that buildings probably line these streetsand, moreover, that no suitable path exists in the negative space 210since no road features 204 are depicted. However, the negative space 210is not capable of imparting much more information to a user.

Moreover, while global map 202 has many other shortcomings. For example,when a user desires to locate his position on the map 202, the onlyviable way of doing such is by road intersections (e.g. roads orfeatures 204 in relation to each other). The user typically has noinformation regarding sub-features on a road, unless some landmark onthe road is marked on the map 202. As such, global map 202 could beimproved to display even more information, which is discussed infra.

Referring back to FIG. 1, the global map 102 illustrates feature 104 atfeature position 106. As is inherent in maps, this feature 104 usuallyrepresents an object in the “real” world (e.g., corporeal). Similarly,the feature position 206 translates to a particular corporeal location.Accordingly, in order to simplify explanation and provide clarity, asused herein and in the appended claims, feature 104 and feature position106 can denote the feature 104 and feature position 106, respectively,on the global map 102 as well as the corporeal scene depicted at thecorporeal location, respectively. In accordance therewith, the system100 can also include a local image 1 10. The local image 110 can relateto the feature 104 in a very direct way. For example, if the feature 104is, e.g. a statue, then the local image 110 can be a photographicrepresentation of the statue.

However, in accordance with another aspect, the local image 110 need notdepict the feature 104. Rather, in some cases, the local image 110 candepict a scene that is visible from feature position 106, but is nototherwise related to the feature 104. For example, if the feature 104represented on the global map 102 is a road, the local image 110 candepict a house or building that is visible from that feature position106 on the road (e.g., feature 104), without including, or onlytangentially including the actual road.

Accordingly, while the local image 110 can depict the feature 104, localimage 110 can be more conveniently described as an image of a scene froma vantage point at or near the feature position 106. That is, an imageof a scene (e.g., local image 110) at or near feature position 106 doesnot necessarily, but can include the feature 104. It is to beappreciated while only one local image 110 is shown, the system 100 caninclude a plurality of local images 110, each of which can depict ascene at various feature position(s) 106. It is to be furtherappreciated that the local image 110 can be a single image, a panorama(e.g., employing technologies such as push-broom, image stitching, orany other technology for constructing a panorama), and/or a 3-D model(discussed infra regarding FIGS. 6A-6B) of the feature 104. The localimage 110 is typically a first-person, ground-level perspective of thescene, but such is not always the case, e.g., when the local image is a3-D model or when the local image depicts a scene along a route that isnot at ground level such as the top floor of a building.

An exemplary local image 212 is depicted in FIG. 2B. The local image 212is a panorama of a street-side scene. Generally, panoramas arecontinuous images of a street/road side, and can be generated in anumber of ways. For example, a panorama can be a sequence of imagesalong a path stitched together. The stitching can employ, e.g., depthmeasurements of the scene (such as stereo matching or from LightDetecting And Ranging (LIDAR) techniques), edge detection techniques,distances from perspective axes, and/or the like. The panorama can alsobe generated by directly capturing orthographic imagery using, e.g. apush-broom camera that captures one column of the final image at a time.Such a panorama (e.g., local image 212) can be generated by a camerathat is mounted on a vehicle traveling along a street or as a stitchingof photography taken on foot.

Regardless of the technology employed to create the panorama, it is tobe appreciated that each segment along a path, or on a road on the map(e.g. along a road/feature 204 of global map 202 from FIG. 2A) candefine two such street-side panoramas, one for each side of thestreet/road. By employing local image 212, it is quite easy to identifya specific location such as a store, a house, etc., since therepresentation is very close to the corporeal view of the object fromthe perspective of a ground-level viewer. However, from such a panorama(e.g., local image 212), it is not obvious where is the actual locationof the house is in the world or in relation to a global map (e.g.,global map 102 from FIG. 1).

For example, it is not clear if the depicted street-side scene follows aroad that runs from north to south or from east to west, if the roadcurves, or how far the road continues. It is also hard to visualize howone street-side scene will interact with another, e.g. when switchingfrom one street-side scene or image to another such as when the travelerchanges locations. Furthermore, many tasks, such as driving directionsor description of a neighborhood require the description of more thanone side of a street at a time. Thus, there are also a number ofshortcomings with street-side images because most global informationsuch as that contained in orthographic projection maps are not present.As such, navigation by these types of images can be very difficult andalso require many images that must be independently retrieved and, aswell, cannot be easily printed and carried along with a traveler.

Referring again back to FIG. 1, the system 100 can also include aninterpolation component 112. The interpolation component 112 can createa hybrid map 114 by, e.g., interpolating the data found in the globalmap 102 with data resident in the local image 110. Accordingly, theinterpolation component 112 can embed the local image 110 in the globalmap 102 to produce the hybrid map 114. Generally, the hybrid map 114retains the structure of the global map 102 that is effective atillustrating global information such as distances, orientation,curvature of roads, and/or other relationships between the features 104.In addition, hybrid map 114 can also employ effective visualizationimagery found in local image 110. It is also to be appreciated that thelocal image 110 displayed on the hybrid map 114 can also be embeddedwith hyperlinks (not shown). As such, a user viewing the hybrid map 114in a setting that allows hyperlinks, can click on the local image 110 toreceive more information about this scene and/or feature.

In accordance with one aspect, the interpolation component 112 can makebetter use of the negative space 210 (from FIG. 2A) by inserting thelocal image(s) 110 along the sides of the roads. For example, if thepanoramic local image 212 (from FIG. 2B) depicts a scene along one sideof road 206 (from FIG. 2A), then the local image 212 can be interpolatedat or near a feature position of road/feature 206. Such an interpolationcan be found with reference to FIG. 3, which depicts a hybrid map 300with a global map 302 (shown here as a portion of the global map 202from FIG. 2) interpolated with the street-side panorama local image 212.The orientation of the local image 212 can be with reference to theparticular road from which the image 212 was captured. The orientationcan also be achieved based upon compass directions as described below.

Turning now to FIG. 4, a hybrid map 400 in accordance with anotheraspect of the claimed subject matter is illustrated. The hybrid map 400represents a portion of the underlying global map 202, bounded by asection 402. As shown, the hybrid map 400 maintains the structure of theunderlying global map 202 and therefore maintains important globalinformation relevant to a user/traveler. In addition, the hybrid map 400also shows street-side panoramas 404. It is relevant to note that thesestreet-side panoramas 404 are shown on both sides of a given road (e.g.,feature of the global map) as illustrated by elements 406. In this case,the rendering of the street-side panoramas 404-406 is not realistic,since there is no single point-of-view showing all street sides.

However, the view of the street side, allows for fast recognition ofobjects on the scene, from ground level. On the other hand, since theglobal map 202 structure is maintained, the user can localize herself,understand the street direction, the direction and distances to hertarget, the relations to other streets, both those that intersect thestreet where she is walking/driving and those parallel to it. Hence, atany point, the user can localize herself and be reassured of her currentlocation by recognizing the objects around her represented by thestreet-side panoramas 404-406 on the street, where she is located.Moreover, all this information is available in a single representation(e.g., the hybrid map 400), which is readily printable; and while accessto the Internet or cache is available, the street-side panoramas 404-406can be clicked on (e.g., embedded with hyperlinks) to yield morein-depth information.

With reference now to FIGS. 5A through FIG. 7, various exemplary hybridmaps 500, 502, 600, 602 and 700, respectively, in accordance withnumerous other aspects are depicted. Hybrid map 500 illustrates a streetmap interpolated with images of house and trees along the streets, asscene from the represented street. Hybrid map 502 shows the same streetmap interpolated with nearly identical images of the street scene, butin which the sky has been removed and separation of the houses has beenimplemented to provide clarity and/or additional reference to the user.

Hybrid map 600 is a map in which the street-side images (e.g., localimages) are 3-D models. Hybrid map 602 similarly employs 3-D models asthe street-side images interpolated onto the global map, but thegraphics of the road and cars, etc. are replaced with a streetrepresentation and street name. In addition, the roof structures of thehouses have been removed and neighboring houses are separated with apartition.

Hybrid map 700 once again maintains the structure of a road map, butdoes not use panoramas as the local images. Rather, Hybrid map 700employs a plurality of individual images that are arranged at theappropriate locations along the road. Hybrid map 700 also provides anindication of a user's current location with an icon 702 as well as theuser's current direction of travel, denoted by the light cone 704.

An exhaustive list of all the potential embodiments is, of course notpossible. Other embodiments exist and are considered to be with thescope of this disclosure and appended claims. However, the givenexamples suffice to introduce a variety of concepts relevant to aid inan understanding of the claimed subject matter, and other concepts canbe readily identified by one of ordinary skill in the art. For example,with reference to FIGS. 5A-7, it can be understood that the actual styleof display for a hybrid map is not fixed, but rather can be varied forsuitability of the application. For instance, different display stylescan be employed based upon, e.g., the types of local images that areavailable (e.g. single images versus panorama images, etc.), the type ofglobal map employed (e.g., a road map versus a physical map, etc.), thedensity of features represented on the global map (e.g. a rural areawith lots of negative space between road versus an urban area withrelatively little negative space, etc.), as well as other factors.

In accordance therewith, the display style might be varied such thatblock sides can be projected on the sides of the street as parallelrectangles (e.g., hybrid maps 500, 502, and 700) or as trapezoidalshapes (e.g., hybrid maps 600 and 602). In order to enhance readabilityor, e.g., satisfy a user preference, the hybrid maps can also bedisplayed such that the sky, rooftops, or distant objects are removedfrom the local images (e.g., hybrid maps 502 and 602). In addition,distinct objects in the street-side scene can be separated, e.g., bysharp edges or highlights to accentuate the distinct objects. As well,some objects can be determined to be more important than other objects.As such the more important objects can be offset in various ways toillustrate the relative importance. For example, the important objectsin a scene can be depicted as larger than the less important objects inthe scene. Additionally or alternatively, the object can be depictedwith a different amount of contrast to highlight or de-emphasize theobject based upon its importance.

Emphasizing and/or de-emphasizing (or omitting entirely) objects in ascene can be of particular importance to a traveler. For example, hybridmaps 500-700 generally depict a representation of an urban area. Asdescribed, these hybrid maps 500-700 can be very useful for a travelerexploring the areas depicted by the map(s). In one case the travelermight be searching for a particular house. Typical orthographic mapsmight not show the requisite detail to represent houses at all, or if soonly represent the house as, e.g., a square which is indistinguishablefrom other similar squares that denote other houses. The hybrid mapscan, however, also provide a visual of the particular house in questionindicating to the traveler the proper destination sought. In anothercase, a city tourist may remember that he parked on a street next to acertain identifiable building (e.g. because it had a distinct shape orcolor) but otherwise does not know exactly where he parked. In eithercase, the hybrid maps can aid the user by appropriately integratinguseful information from both global maps and local images.

However, in other situations, especially when a traveler is concernedwith planning routes from point A to point B, objects depicted in thestreet-side scene (e.g., local image) need not be given equal emphasis.Generally, a good map is one that provides the viewer with usefulinformation, but not so much that extraneous information detracts fromthe experience. Accordingly, objects at important locations (e.g., atintersections along a planned route) can be emphasized with the use ofsize and/or contrast, while objects of lesser importance along the routecan be de-emphasized with size, contrast, and/or by omitting entirely.For example, a traveler might be very interested to see the local imageof a gas station where his planned route indicates he is to turn, butmight not be interested in a local image of a statue in the middle of avery long portion of the route with no nearby changes in course. In thatcase, the gas station can be emphasized and the statue can bede-emphasized or removed from the map altogether.

In accordance with another aspect of the claimed subject matter, it isto be understood and appreciated that the actual projection of theimages may be an orthographic projection along the x-axis or it may bean orthographic projection in the y-axis direction. In either case, theprojection can retain certain perspective. Moreover, while the localimages can be single images, panorama images, 3-D models, etc., it isnot necessarily important how these local images are obtained or how thepanoramas are created.

Referring briefly to FIG. 8, an exemplary corporeal environment 800 isdepicted. The environment 800 can include an object 802 that is situatedalong Main Street 804. On the opposite side of Main Street 804 is acamera location 806 in which a camera (not shown) photographs a scenebounded by points 808 and 810. Here, the scene 808-810 is a portion ofthe object 802; however, the scene could entirely encompass the object802 or encompass all or portions of several proximal objects 802.Accordingly, the scene 808-810 can represent a local image (e.g., localimage 110 from FIG. 1). A perspective axis 812 is also depicted,denoting the line of sight from the camera location 806 to the object802.

Since the corporeal environment 800 inherently includes compassinformation, illustrated here by the compass rose 814, this informationcan be included in the local image that represents the scene 808-810.For example, metadata can be embedded in the image that describes thedirection the camera was facing when the image of scene 808-810 wascaptured. This can be accomplished by, e.g., a camera equipped with acompass device that automatically inputs the metadata, or by any othermeans such as a component independent of the camera capable of embeddingcompass/directional metadata. This compass metadata can be useful inorienting local images, but is not necessary as can be seen withreference to FIG. 9.

Turning now to FIG. 9, an exemplary hybrid map 900 is illustrated. Asdescribed supra, the hybrid map 900 can insert properly oriented localimages 902 of an object or scene, while maintaining certain globalinformation such as features from a global map. In the case where thehybrid map 900 employs a road map, the primary features on the hybridmap will be roads, such as Main Street 904. Accordingly, the image 902can be readily oriented based upon the road 904. That is, the angle inwhich the camera was facing when the image 902 was captured need not beknown when, e.g., it is known that the scene depicted in the image 902is a street-side image along Main Street 904. Thus, the image 902 can beproperly oriented and displayed in accordance with any of the displaystyles described herein.

However, as with global maps, hybrid maps (e.g., hybrid map 900)typically, are oriented such that north faces up, as indicated by thecompass rose 906. Thus, the image 902 can also be oriented with respectto a compass direction, if such information is available (e.g., fromimage metadata). In broken lines, overlaying the compass rose 906, alsoshown is the perspective axis 812 (from FIG. 8) and an angle, α 908 thatshows the angle between the perspective axis 812 and north on thecompass 906. As such, image 902 could also be oriented by rotating theimage α 908 degrees. This could be especially useful when, e.g., thereare not any nearby features (e.g., roads) or when the underlying globalmap is not a road map.

With reference now to FIG. 10, a computer-implemented system 1000 thatcan provide local information at or near a feature on a global map isillustrated. Generally, the system 1000 can include an interpolationcomponent 1002 that can generate a hybrid map 1004. The hybrid map 1004can maintain relevant global information found in global map 1006, whichcan be substantially similar to global map 102 described with referenceto FIG. 1. Hybrid map 1004 can also include important visual recognitioninformation found in images 1008 ₁-1008 _(N), referred to collectivelyor individually as images 1008. It is to be appreciated that althoughthe images 1008 can be referred to collectively, hereafter eachrespective image 1008 can have unique properties that distinguish eachof images 1008.

It is to be further appreciated that an image of an object or scene(e.g., image 1008) can be captured from different directions. Forexample, the image of a building on a corner created by the intersectionof two roads can appear different depending upon theperspective/direction an observer faces. That is, the building may lookdifferent from the side visible to a road traversing the north-southdirection than it appears from a second road heading in the east-westdirections. Accordingly, it is significant to distinguish these objectimages 1008, even though each image 1008 depicts the same object (albeitfrom different directions 1010 ₁-1010 _(O), also referred to hereineither collectively or individually as direction 1010).

Accordingly, all the images 1008 can be aligned on the hybrid map 1004such that each street (e.g. feature taken from the global map 1006) hasa representation of what a traveler will see when, e.g., walking ordriving down that street. In some cases, this can give a non-perspectiveimage, e.g. if the traveler sees a house and this house is bounded onall sides by streets, the traveler will see images 1008 of the samehouse from four different directions 1010 displayed on the hybrid map1004, each one along the corresponding street.

In accordance therewith, the interpolation component 1002 can insert theimages 1008 at a proper location on the global map 1006 to create thehybrid map 1004. In addition, the interpolation component often mustalso properly orient the images 1008 within the hybrid map 1004 inconnection with the global map 1006. This can be accomplished in severaldifferent ways. One way is to align the images 1008 with features (notshown) depicted on the global map 1006, e.g., roads. Another way toalign the images 1008 is to employ compass directional data relating tothe perspective axis of an image, e.g. when there are no nearby globallyaligned features and directional metadata is available.

The system 1000 can also include an intelligence component 1012 that canbe integrated in the interpolation component 1012 or, as depicted herebe operatively coupled to the interpolation component 1012. Theintelligence component can, inter alia, aid the interpolation component1002 in determining how to orient the images 1008 on the hybrid map1004, e.g., which method of orientation to employ or when one method ispreferable to another. As described herein, the interpolation component1002 can also render the hybrid map 1004 with different display stylesas well as deciding which objects are more important than other objectswhen object emphasis and de-emphasis is desired. The intelligencecomponent 1012 can be employed to aid in these tasks as well.

For example, the intelligence component 1012 can examine the entirety ora subset of the data available (e.g., data relating to the global map1006, the images 1008, the density of features in the mapped surface,the type of map or maps, the types of the image or images . . . ) andcan provide for reasoning about or infer states of the system,environment, and/or user from a set of observations as captured viaevents and/or data. Inference can be employed to identify a specificcontext or action, or can generate a probability distribution overstates, for example. The inference can be probabilistic—that is, thecomputation of a probability distribution over states of interest basedon a consideration of data and events. Inference can also refer totechniques employed for composing higher-level events from a set ofevents and/or data.

Such inference results in the construction of new events or actions froma set of observed events and/or stored event data, whether or not theevents are correlated in close temporal proximity, and whether theevents and data come from one or several event and data sources. Variousclassification (explicitly and/or implicitly trained) schemes and/orsystems (e.g. support vector machines, neural networks, expert systems,Bayesian belief networks, fuzzy logic, data fusion engines . . . ) canbe employed in connection with performing automatic and/or inferredaction in connection with the claimed subject matter.

A classifier is a function that maps an input attribute vector, x=(x1,x2, x3, x4, xn), to a confidence that the input belongs to a class, thatis, f(x)=confidence(class). Such classification can employ aprobabilistic and/or statistical-based analysis (e.g., factoring intothe analysis utilities and costs) to prognose or infer an action that auser desires to be automatically performed. A support vector machine(SVM) is an example of a classifier that can be employed. The SVMoperates by finding a hypersurface in the space of possible inputs,where the hypersurface attempts to split the triggering criteria fromthe non-triggering events. Intuitively, this makes the classificationcorrect for testing data that is near, but not identical to trainingdata. Other directed and undirected model classification approachesinclude, e.g. naive Bayes, Bayesian networks, decision trees, neuralnetworks, fuzzy logic models, and probabilistic classification modelsproviding different patterns of independence can be employed.Classification as used herein also is inclusive of statisticalregression that is utilized to develop models of priority.

In accordance with the foregoing and still referring to FIG. 10, thehybrid map 1004 can be a very convenient solution with a much richer setof information provided to a user. The hybrid map 1004 street-sideimagery within the context of a global map (e.g., global map 1006). Thegeneral structure of the map represents the global information(distances, orientation, curvature of the streets, relation betweenneighboring streets, etc.), while the imagery, displayed on both sidesof every street or road, shows the local information. All thisinformation can be provided in a single image that is printable,allowing the user to print the hybrid map 1004 and carry the map alongwithout the need of scores or even hundreds of local image printoutsand/or persistent access to the Internet during travel. The user canscan the hybrid map 1004, looking for a specific target, or get a globalunderstanding of the area (e.g., “Here is a nice street, that has a lotof trees”, or “here is a gas station or an interesting spot on theway”).

FIG. 11 illustrates a process flow diagram of a computer-implementedmethod 1100 for generating a hybrid map that provides local featuredetail and global map context. While, for purposes of simplicity ofexplanation, the one or more methods shown herein, e.g. in the form of aflow chart, are shown and described as a series of acts, it is to beunderstood and appreciated that the subject invention is not limited bythe order of acts, as some acts may, in accordance with the invention,occur in a different order and/or concurrently with other acts from thatshown and described herein. For example, those skilled in the art willunderstand and appreciate that a methodology could alternatively berepresented as a series of interrelated states or events, such as in astate diagram. Moreover, not all illustrated acts may be required toimplement a methodology in accordance with the invention.

At 1102, an image or set of images of a corporeal object can be receivedthat relates to a location on an orthographic projection map. The imagescan be a first-person, ground-level image such as a street-side imageand can be in the form of a single object image, a panorama, a 3-Dmodel, and/or the like. The object can be imaged in whole or in part orit could be only one of a plurality of objects in the image or images.Moreover, the set of images could depict the same object but fromdifferent directions of view.

At 1104, a location for the image can be determined, e.g., based uponthe position on a global map of the object depicted. At 1106, anorientation for the image can be determined. The orientation can bedetermined relative to features on a global map (e.g., roads) or basedupon an objective compass direction. For example, metadata can beembedded in an image describing the direction of the perspective axiswhen the image was recorded. At 1108, a display style can be determinedbased upon a variety of factors. For instance, different display stylescan be chosen based upon, e.g., the types of local images that areavailable, the type of global map employed, the density of featuresrepresented on the global map as well as other factors. Hence, thedisplay style may be selected based upon whether the local images aresingle images, panoramas, 3-D images, etc. Similarly, the display stylemay vary based upon whether the orthographic projection map is a roadmap or another type of map. As well, the display style can be selecteddepending upon whether the orthographic projection map depicts a ruralarea or an urban area. At 1110, the image can be inserted in a hybridmap with the determined display type at the determined location and atthe determined orientation.

Turning now to FIG. 12A, an ancient map from circa 6th century A.D. isshown. The map is a part of a mosaic floor discovered in the ancientcity of Midba, depicting a map of ancient Jerusalem. While the mainstreet of the city shows the houses on both sides of the street, allhouses are drawn from a single viewpoint, as the artist imagined them.That is, the houses are not shown from multiple perspectives, but ratheronly from a single perspective, which is roughly from the very center ofthe map. Hence, each house is only depicted once from the centralperspective, so there is no consistent rendering of the views seen fromstreets other than the main, central street. Thus, perspectives, andtherefore scenes/views of the houses as would be observed from anystreet other than the main street are not shown, since the houses alongthem are already drawn with respect to the central perspective.Moreover, while the map of Jerusalem also depicts an orthographicprojection (located at the far left of the map), the local images arenot provided in that context.

With reference now to FIG. 12B a three-dimensional rendering of acontemporary city street is depicted. In this case, more than one faceof some of the buildings can be seen simultaneously, however, the viewis again based upon a dominant perspective that is located at the centerof the map. Hence, a user of this map can see various details of localfeatures/objects, but only from the dominant perspective. Moreover, theuser is not provided the context of a global orthographic projectionmap. Accordingly, none of these maps (e.g., maps depicted in FIGS. 12Aand 12B) represent a geographical area, such as represented in anorthographic projection map from multiple possible ground view points,while, in addition, maintaining the global positioning information.

Referring now to FIG. 13, there is illustrated a block diagram of anexemplary computer system operable to execute the disclosedarchitecture. In order to provide additional context for various aspectsof the claimed subject matter, FIG. 13 and the following discussion areintended to provide a brief, general description of a suitable computingenvironment 1300 in which the various aspects of the claimed subjectmatter can be implemented. For example, various components of thesystems and/or aspects thereof described supra can be implemented by wayof the system 1300. Additionally, while the claimed subject matter hasbeen described above in the general context of computer-executableinstructions that may run on one or more computers, those skilled in theart will recognize that the claimed subject matter also can beimplemented in combination with other program modules and/or as acombination of hardware and software.

Generally, program modules include routines, programs, components, datastructures, etc., that perform particular tasks or implement particularabstract data types. Moreover, those skilled in the art will appreciatethat the inventive methods can be practiced with other computer systemconfigurations, including single-processor or multiprocessor computersystems, minicomputers, mainframe computers, as well as personalcomputers, hand-held computing devices, microprocessor-based orprogrammable consumer electronics, and the like, each of which can beoperatively coupled to one or more associated devices.

The illustrated aspects of the claimed subject matter may also bepracticed in distributed computing environments where certain tasks areperformed by remote processing devices that are linked through acommunications network. In a distributed computing environment, programmodules can be located in both local and remote memory storage devices.

A computer typically includes a variety of computer-readable media.Computer-readable media can be any available media that can be accessedby the computer and includes both volatile and nonvolatile media,removable and non-removable media. By way of example, and notlimitation, computer-readable media can comprise computer storage mediaand communication media. Computer storage media can include bothvolatile and nonvolatile, removable and non-removable media implementedin any method or technology for storage of information such ascomputer-readable instructions, data structures, program modules orother data. Computer storage media includes, but is not limited to, RAM,ROM, EEPROM, flash memory or other memory technology, CD-ROM, digitalversatile disk (DVD) or other optical disk storage, magnetic cassettes,magnetic tape, magnetic disk storage or other magnetic storage devices,or any other medium which can be used to store the desired informationand which can be accessed by the computer.

Communication media typically embodies computer-readable instructions,data structures, program modules or other data in a modulated datasignal such as a carrier wave or other transport mechanism, and includesany information delivery media. The term “modulated data signal” means asignal that has one or more of its characteristics set or changed insuch a manner as to encode information in the signal. By way of example,and not limitation, communication media includes wired media such as awired network or direct-wired connection, and wireless media such asacoustic, RF, infrared and other wireless media. Combinations of the anyof the above should also be included within the scope ofcomputer-readable media.

With reference again to FIG. 13, the exemplary environment 1300 forimplementing various aspects of the claimed subject matter includes acomputer 1302, the computer 1302 including a processing unit 1304, asystem memory 1306 and a system bus 1308. The system bus 1308 couples tosystem components including, but not limited to, the system memory 1306to the processing unit 1304. The processing unit 1304 can be any ofvarious commercially available processors. Dual microprocessors andother multi-processor architectures may also be employed as theprocessing unit 1304.

The system bus 1308 can be any of several types of bus structure thatmay further interconnect to a memory bus (with or without a memorycontroller), a peripheral bus, and a local bus using any of a variety ofcommercially available bus architectures. The system memory 1306includes read-only memory (ROM) 1310 and random access memory (RAM)1312. A basic input/output system (BIOS) is stored in a non-volatilememory 1310 such as ROM, EPROM, EEPROM, which BIOS contains the basicroutines that help to transfer information between elements within thecomputer 1302, such as during start-up. The RAM 1312 can also include ahigh-speed RAM such as static RAM for caching data.

The computer 1302 further includes an internal hard disk drive (HDD)1314 (e.g., EIDE, SATA), which internal hard disk drive 1314 may also beconfigured for external use in a suitable chassis (not shown), amagnetic floppy disk drive (FDD) 1316, (e.g., to read from or write to aremovable diskette 1318) and an optical disk drive 1320, (e.g., readinga CD-ROM disk 1322 or, to read from or write to other high capacityoptical media such as the DVD). The hard disk drive 1314, magnetic diskdrive 1316 and optical disk drive 1320 can be connected to the systembus 1308 by a hard disk drive interface 1324, a magnetic disk driveinterface 1326 and an optical drive interface 1328, respectively. Theinterface 1324 for external drive implementations includes at least oneor both of Universal Serial Bus (USB) and IEEE 1394 interfacetechnologies. Other external drive connection technologies are withincontemplation of the claimed subject matter.

The drives and their associated computer-readable media providenonvolatile storage of data, data structures, computer-executableinstructions, and so forth. For the computer 1302, the drives and mediaaccommodate the storage of any data in a suitable digital format.Although the description of computer-readable media above refers to aHDD, a removable magnetic diskette, and a removable optical media suchas a CD or DVD, it should be appreciated by those skilled in the artthat other types of media which are readable by a computer, such as zipdrives, magnetic cassettes, flash memory cards, cartridges, and thelike, may also be used in the exemplary operating environment, andfurther, that any such media may contain computer-executableinstructions for performing the methods of the claimed subject matter.

A number of program modules can be stored in the drives and RAM 1312,including an operating system 1330, one or more application programs1332, other program modules 1334 and program data 1336. All or portionsof the operating system, applications, modules, and/or data can also becached in the RAM 1312. It is appreciated that the claimed subjectmatter can be implemented with various commercially available operatingsystems or combinations of operating systems.

A user can enter commands and information into the computer 1302 throughone or more wired/wireless input devices, e.g. a keyboard 1338 and apointing device, such as a mouse 1340. Other input devices (not shown)may include a microphone, an IR remote control, a joystick, a game pad,a stylus pen, touch screen, or the like. These and other input devicesare often connected to the processing unit 1304 through an input deviceinterface 1342 that is coupled to the system bus 1308, but can beconnected by other interfaces, such as a parallel port, an IEEE 1394serial port, a game port, a USB port, an IR interface, etc.

A monitor 1344 or other type of display device is also connected to thesystem bus 1308 via an interface, such as a video adapter 1346. Inaddition to the monitor 1344, a computer typically includes otherperipheral output devices (not shown), such as speakers, printers, etc.

The computer 1302 may operate in a networked environment using logicalconnections via wired and/or wireless communications to one or moreremote computers, such as a remote computer(s) 1348. The remotecomputer(s) 1348 can be a workstation, a server computer, a router, apersonal computer, portable computer, microprocessor-based entertainmentappliance, a peer device or other common network node, and typicallyincludes many or all of the elements described relative to the computer1302, although, for purposes of brevity, only a memory/storage device1350 is illustrated. The logical connections depicted includewired/wireless connectivity to a local area network (LAN) 1352 and/orlarger networks, e.g., a wide area network (WAN) 1354. Such LAN and WANnetworking environments are commonplace in offices and companies, andfacilitate enterprise-wide computer networks, such as intranets, all ofwhich may connect to a global communications network, e.g., theInternet.

When used in a LAN networking environment, the computer 1302 isconnected to the local network 1352 through a wired and/or wirelesscommunication network interface or adapter 1356. The adapter 1356 mayfacilitate wired or wireless communication to the LAN 1352, which mayalso include a wireless access point disposed thereon for communicatingwith the wireless adapter 1356.

When used in a WAN networking environment, the computer 1302 can includea modem 1358, or is connected to a communications server on the WAN1354, or has other means for establishing communications over the WAN1354, such as by way of the Internet. The modem 1358, which can beinternal or external and a wired or wireless device, is connected to thesystem bus 1308 via the serial port interface 1342. In a networkedenvironment, program modules depicted relative to the computer 1302, orportions thereof, can be stored in the remote memory/storage device1350. It will be appreciated that the network connections shown areexemplary and other means of establishing a communications link betweenthe computers can be used.

The computer 1302 is operable to communicate with any wireless devicesor entities operatively disposed in wireless communication, e.g., aprinter, scanner, desktop and/or portable computer, portable dataassistant, communications satellite, any piece of equipment or locationassociated with a wirelessly detectable tag (e.g., a kiosk, news stand,restroom), and telephone. This includes at least Wi-Fi and Bluetooth™wireless technologies. Thus, the communication can be a predefinedstructure as with a conventional network or simply an ad hoccommunication between at least two devices.

Wi-Fi, or Wireless Fidelity, allows connection to the Internet from acouch at home, a bed in a hotel room, or a conference room at work,without wires. Wi-Fi is a wireless technology similar to that used in acell phone that enables such devices, e.g., computers, to send andreceive data indoors and out; anywhere within the range of a basestation. Wi-Fi networks use radio technologies called IEEE 802.11 (a, b,g, etc.) to provide secure, reliable, fast wireless connectivity. AWi-Fi network can be used to connect computers to each other, to theInternet, and to wired networks (which use IEEE 802.3 or Ethernet).Wi-Fi networks operate in the unlicensed 2.4 and 5 GHz radio bands, atan 11 Mbps (802.11a) or 54 Mbps (802.11b) data rate, for example, orwith products that contain both bands (dual band), so the networks canprovide real-world performance similar to the basic 10BaseT wiredEthernet networks used in many offices.

Referring now to FIG. 14, there is illustrated a schematic block diagramof an exemplary computer compilation system operable to execute thedisclosed architecture. The system 1400 includes one or more client(s)1402. The client(s) 1402 can be hardware such as a digital camera withcomputer interface support and/or software (e.g., threads, processes,computing devices). The client(s) 1402 can house cookie(s) and/orassociated contextual information by employing the claimed subjectmatter, for example.

The system 1400 also includes one or more server(s) 1404. The server(s)1404 can also be hardware and/or software (e.g., threads, processes,computing devices). The servers 1404 can house threads to performtransformations by employing the claimed subject matter, for example.One possible communication between a client 1402 and a server 1404 canbe in the form of a data packet adapted to be transmitted between two ormore computer processes. The data packet may include a cookie and/orassociated contextual information, for example. The system 1400 includesa communication framework 1406 (e.g., a global communication networksuch as the Internet) that can be employed to facilitate communicationsbetween the client(s) 1402 and the server(s) 1404.

Communications can be facilitated via a wired (including optical fiber)and/or wireless technology. The client(s) 1402 are operatively connectedto one or more client data store(s) 1408 that can be employed to storeinformation local to the client(s) 1402 (e.g., cookie(s) and/orassociated contextual information). Similarly, the server(s) 1404 areoperatively connected to one or more server data store(s) 1410 that canbe employed to store information local to the servers 1404.

What has been described above includes examples of the claimed subjectmatter. It is, of course, not possible to describe every conceivablecombination of components or methodologies for purposes of describingthe claimed subject matter, but one of ordinary skill in the art mayrecognize that many further combinations and permutations of the claimedsubject matter are possible. Accordingly, the claimed subject matter isintended to embrace all such alterations, modifications and variationsthat fall within the spirit and scope of the appended claims.Furthermore, to the extent that the terms “includes” or “include” areused in either the detailed description or the claims, such term isintended to be inclusive in a manner similar to the term “comprising” as“comprising” is interpreted when employed as a transitional word in aclaim.

1. A computer-implemented system that provides local information at ornear a feature on a global map, comprising: a global map with a featureat a feature position; a local image that depicts an object visible fromthe feature position; and an interpolation component that embeds thelocal image in the global map to produce a hybrid map.
 2. The system ofclaim 1, the interpolation component embeds the local image at or nearthe feature position.
 3. The system of claim 1, the interpolationcomponent embeds the local image oriented with respect to the feature.4. The system of claim 1, the global map is an orthogonal map of asurface.
 5. The system of claim 1, the global map is a road map and thefeature is a road.
 6. The system of claim 5, the interpolation componentinserts the local image at or near the feature position along the roadoriented with respect to the road.
 7. The system of claim 1, theinterpolation component inserts the local image at or near the featureposition oriented such that a perspective axis of the local image isaligned with a compass direction for the global map.
 8. The system ofclaim 1, further comprising an intelligence component that determines atleast one of an orientation of the local image, a display style of thelocal image, and an importance of an object in the local image.
 9. Thesystem of claim 8, the display style is at least one of parallelrectangles, trapezoidal shapes, two-dimensional representations, andthree-dimensional representations.
 10. The system of claim 8, the objectis at least one of emphasized and de-emphasized based at least in partupon the importance of the object.
 11. The system of claim 1, the localimage is a street-side image.
 12. The system of claim 1, the local imageis a panorama image.
 13. The system of claim 1, the local image is athree-dimensional model.
 14. The system of claim 1, the local imageembedded in the hybrid map includes a hyperlink to informationassociated with at least one of the local image, an object of the localimage, the feature, the feature position, and an object at or near thefeature position.
 15. The system of claim 1, further comprising aplurality of local images of the object, each of the respective localimages depicts the object from a different perspective.
 16. The systemof claim 15, each of the plurality of local images is oriented on thehybrid map based upon at least one of alignment with the feature,alignment relative to a second feature, alignment relative to a secondobject, and alignment of a perspective axis with a compass direction forthe global map.
 17. The system of claim 15, the hybrid map displaysmultiple perspectives of the object in a single, printablerepresentation.
 18. A hybrid map that provides local information aboutan object at or near a feature on a map, comprising: a global map with afeature at a feature position, the global map is an orthogonalperspective map; and a plurality of local images of an object at or nearthe feature, each of the plurality of local images depicts the objectfrom a different perspective and each of the plurality of local imagesare arranged around the feature position on the global map based uponthe respective perspective.
 19. The hybrid map of claim 18, furthercomprising a plurality of objects, each of the respective objects isdisplayed from multiple perspectives simultaneously.
 20. Acomputer-implemented method for generating a hybrid map that provideslocal detail information and global map context, comprising: receiving astreet-side image of a corporeal object that corresponds to a scene at alocation on an orthographic projection map; determining a location forthe street-side image; determining an orientation of the street-sideimage; determining display style for the street-side image; insertingthe street-side image in a hybrid map with the determined display styleat the determined location and at the determined orientation.